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Floating Point Buffer System and Method for Use 

During Programmable Fragment Processing In a 

Graphics Pipeline 



FIELD OF THE INVENTION 

The present invention relates to computer graphics, and more particularly to 
fragment processing in a graphics pipeline. 

Background of the Invention 

Conventional fragment processing for three-dimensional (3-D) graphics 
programming application program interfaces (APIs) such as Open Graphics Library 
(OpenGL®) and Direct3D™ provide support for per-fragment operations. The 
computations provided by such conventional fragment processing are routinely 
implemented by 3-D graphics hardware that greatly accelerates these operations. 

Unextended OpenGL mandates a certain set of configurable per-fragment 
computations defining texture lookup, texture environment, color sum, and fog 
operations. Each of these areas provides a useful but limited set of fixed operations. 
For example, unextended OpenGL 1.2.1 provides only four texture environment 
modes, color sum, and three fog modes. 

One drawback associated with the current state of the art graphics APIs is 
that most computations dealing with color or depth buffers are typically constrained 
to operate on values in the range [0,1]. Computational results are also typically 

NVIDP069/P000051 V3.0 



clamped to the range [0,1]. Color, texture, and depth buffers themselves also hold 
values mapped to the range [0,1]. Unfortunately, these constraints and the limited 
precision of typical computations can result in reduced accuracy during graphics 
processing. 

Further, some [0]quantities that users of programmable graphics APIs would 
like to compute do not necessarily correspond in number or in range to conventional 
attributes such as RGB A colors or depth values. Because of the range and precision 
constraints imposed by conventional fixed-point color buffers, it may be difficult (if 
not impossible) to use them to implement certain multi-pass algorithms where the 
intermediate results need to be stored in the frame buffer. 

There is thus a need for an application program interface that provides a 
frame buffer and texture format that allows fragment programs and other 
applications to read and write unconstrained floating point data. 
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DlSCLOSURE OF THE INVENTION 

A system, method and computer program product are provided for buffering 
5 data in a computer graphics pipeline. Graphics floating point data is produced in a 
graphics pipeline. The graphics floating point data are operated upon in the graphics 
pipeline. Further, the graphics floating point data is stored to the buffer in the 
graphics pipeline. 



10 In one embodiment, the graphics floating point data may be read and stored 

in an undamped format for increasing a precision and/or range thereof. Further, the 
h precision of the graphics floating point data so processed may be only may be only 

constrained by an underlying data type. 

4 j 15 As an option, the graphics floating point data may include fragment data, 

* color data, depth data, etc. Such fragment data may be received from a rasterizer. 



In another embodiment, the buffer may serve as a texture map. Optionally, 
the graphics floating point data may be packed and/or unpacked, whereby a 
20 technique is provided for encoding and decoding multiple low-precision data items 
stored in a single higher-precision data format. 



Another system, method and computer program product are provided for 
buffering data during multi-pass rendering in a computer graphics pipeline. Initially, 
25 graphics floating point data are operated on during a rendering pass in a graphics 
pipeline. During this operation, graphics floating point data may be read from a 
buffer. Further, the graphics floating point results produced by the rendering pass 
are stored to the buffer. During use, the foregoing operations may be repeated 
during additional rendering passes. 
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As an option, the operating step may include deferred shading, where 
computationally expensive fragment operations may be deferred until it is known 
that the fragment will be visible in the final rendered scene. 

These and other advantages of the present invention may become apparent upon 
reading the following detailed description and studying the various figures of the 
drawings. 
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Brief Description of the Drawings 



The foregoing and other aspects and advantages are better understood from 
the following detailed description of a preferred embodiment of the invention with 
reference to the drawings, in which: 

Figure 1 is a diagram illustrating the various components of one embodiment 
of the present invention. 

Figure 2 illustrates a method for programmable fragment processing, in 
accordance with one embodiment. 

Figure 3 illustrates a method for programmable processing of fragment data 
in a computer graphics pipeline, in accordance with operation 204 of Figure 2. 

Figure 4 illustrates a method for buffering data in a computer graphics 
pipeline. 

Figure 5 illustrates new states that may be relevant in the context of the 
present embodiment. 
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Description of the Preferred Embodiments 



Figure 1 is a diagram illustrating the various components of one embodiment 
of the present invention. As shown, the present embodiment includes a plurality of 
modules having a vertex attribute buffer (VAB) 50, a transform module 52, a 
lighting module 54, and a rasterization module 56 with a set-up module 57. 

As an option, each of the foregoing modules may be situated on a single 
semiconductor platform. In the present description, the single semiconductor 
platform may refer to a sole unitary semiconductor-based integrated circuit or chip. 
It should be noted that the term single semiconductor platform may also refer to 
multi-chip modules with increased connectivity which simulate on-chip operation, 
and make substantial improvements over utilizing a conventional CPU and bus 
implementation. Of course, the present invention may also be implemented on 
multiple semiconductor platforms and/or utilizing a conventional CPU and bus 
implementation. 

During operation, the VAB 50 is included for gathering and maintaining a 
plurality of vertex attribute states such as position, normal, colors, texture 
coordinates, etc. Completed vertices are processed by the transform module 52 and 
then sent to the lighting module 54. The transform module 52 generates vectors for 
the lighting module 54 to light. The output of the lighting module 54 is screen space 
data suitable for the set-up module 57 which, in turn, sets up primitives. Thereafter, 
rasterization module 56 carries out rasterization of the primitives. 

An interface may be used in conjunction with the various components set 
forth in Figure 1. In one embodiment, such interface may include at least in part the 
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Open Graphics Library (OpenGL®), Direct3D™ application program interfaces 
(APIs), a proprietary application program interface, or the like. OpenGL® is the 
computer industry's standard application program interface (API) for defining 2-D 
and 3-D graphic images. With OpenGL®, an application can create the same effects 
5 in any operating system using any OpenGL®-adhering graphics adapter. OpenGL® 
specifies a set of commands or immediately executed functions. Each command 
directs a drawing action or causes special effects. OpenGL® and Direct3D™ APIs 
are commonly known to those of ordinary skill, and more information on the same 
may be found by reference to the OpenGL® Specification Version 1.3 which is 
1 0 incorporated herein by reference in its entirety. 

q As is well known, OpenGL mandates a certain set of configurable per- 

Jz: fragment computations defining texture lookup, texture environment, color sum, and 

01 fog operations. Several extensions have been developed to provide further per- 

\l 15 fragment computations to OpenGL®. 



Each of such extensions adds a small set of relatively inflexible per-fragment 
j computations. As mentioned earlier, this inflexibility is in contrast to the typical 

flexibility provided by the underlying programmable floating point engines (whether 
20 micro-coded vertex engines, digital signal processors (DSPs), or central processor 
units (CPUs)) that are traditionally used to implement OpenGL's per-fragment 
computations. 



Figure 2 illustrates a method 200 for programmable fragment processing, in 
25 accordance with one embodiment. Initially, in operation 201, fragment data is 
received in a graphics pipeline. As an option, the fragment data may be received 
from a rasterizer such as that shown in Figure 1. It should be noted, however, that 
the receipt of the fragment data may occur at any point in the graphics pipeline. For 
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example, such receipt may occur in a portion thereof where the following operations 
are being performed. 

As an option, the fragment data may include constant registers associated 
with a fragment, attributes associated with a fragment, color values, etc. Further, the 
attributes may include texture coordinates. It should be noted that the fragment data 
may include any type of data associated with fragments. In the context of the present 
description, a fragment includes any entity generated by rasterization of primitives. 

Next, in decision 202, it is determined whether the graphics pipeline is 
operating in a programmable mode. This may be accomplished via any type of 
signal or command. Just by way of example, a command associated with an 
application program interface may indicate whether the graphics pipeline is 
operating in the programmable mode. Such command may optionally be called by a 
program which governs operation of the graphics pipeline via the application 
program interface. 

If it is determined that the graphics pipeline is operating in the programmable 
mode, programmable operations are performed on the fragment data in order to 
generate output. See operation 204. 

In one embodiment, the programmable operations may include retrieving 
texture data. In particular, such texture data may be retrieved utilizing arbitrary 
texture coordinates. In such embodiment, the fragment program execution 
environment may access textures via arbitrarily computed texture coordinates. As 
such, there is no necessary correspondence between the texture coordinates and 
texture maps previously lumped into a single "texture unit". This technique enables 
implementations where the number of texture coordinate sets and texture image units 
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may differ, providing methods for querying the number of each supported by the 
implementation. 

In another embodiment, the programmable operations may include 
5 mathematical computations. Further, the programmable operations may include a 
kill operation, a partial derivative operation, a texture mapping operation, among 
others. As an option, a packing operation (i.e. PK2, PK4, etc.) and/or an unpacking 
operation (i.e. UP2, UP4, etc.) may be employed. 

10 The PK2/PK4/UP2/UP4 instructions may allow one to store more than four 

(4) quantities in a single buffer in a single pass, assuming it is acceptable to store 
them at lower precision. The PK2/PK4/UP2/UP4 instructions may be useful for 
packing multiple attribute sets into a "wide" frame buffer. For example, a 128-bit 
"RGB A" frame buffer could pack 16 8-bit quantities or 8 16-bit quantities, all of 

1 5 which could be used in later rasterization passes. 

PK2: Pack Two 16-bit Floats 

The PK2 instruction converts the "x" and "y" components of the single 
20 operand into 16-bit floating-point format, packs the bit representation of these two 
floats into a 32-bit value, and replicates that value to all four components of the 
result vector. The PK2 instruction can be reversed by the UP2 instruction mentioned 
below. See Table #1 A. 

25 Table #1 A 

tmpO = VectorLoad (opO) ; 

/* result obtained by combining raw bits of tmpO.x, tmpO.y */ 
result. x = RawBits (tmpO.x) | (RawBits (tmpO .y) « 16); 
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result.y = RawBits (tmpO .x) | (RawBits (tmpO .y) << 16); 
result. z = RawBits (tmpO .x) | (RawBits (tmpO .y) << 16); 
result. w = RawBits (tmpO .x) | (RawBits (tmpO .y) << 16); 

PK4: Pack Four Signed 8-bit Values 

The PK4 instruction converts the four components of the single operand into 
8-bit signed quantities. The signed quantities are represented in a bit pattern where 
all , 0' bits corresponds to -128/127 and all T bits corresponds to +127/127. The bit 
representation of the four converted components are packed into a 32-bit value, and 
that value is replicated to all four components of the result vector. The PK4 
instruction can be reversed by the UP4 instruction below. See Table #1B. 

Table #1B 



tmpO - VectorLoad (opO) ; 

if (tmpO.y < -128/127) tmpO.y = -128/127; 
if {tmpO.z < -128/127) tmpO.z = -128/127; 
if (tmpO.w < -128/127) tmpO.w = -128/127; 
if (tmpO.x > +127/127) tmpO.x = +127/127; 
if (tmpO.y > +127/127) tmpO.y = +127/127; 
if (tmpO.z > +127/127) tmpO.z = +127/127; 
if (tmpO.w > +127/127) tmpO.w = +127/127; 

ub.x = round(127.0 * tmpO.x + 128.0); /* ub is a ubyte vector */ 

ub.y = round(127.0 * tmpO.y + 128.0); 

ub.z = round (127.0 * tmpO.z + 128.0); 

ub.w = round(127.0 * tmpO.w + 128.0); 

/* result obtained by combining raw bits of ub. */ 

result. x = {(ub.x) | (ub.y << 8) | (ub.z « 16) | (ub.w << 24)); 

result. y = ((ub.x) | (ub.y << 8) | (ub.z « 16) | (ub.w « 24)); 

result. z = ((ub.x) | (ub.y << 8) | (ub.z << 16) | (ub.w << 24)); 

result.w = ((ub.x) | (ub.y << 8) | (ub.z << 16) | (ub.w << 24)); 



UP2: Unpack Two 16-Bit Floats 
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The UP2 instruction unpacks two 16-bit floats stored together in a 32-bit 
scalar operand. The first 16-bit float (stored in the 16 least significant bits) is written 
into the "x" and "z" components of the result vector; the second is written into the 
5 "y" and "w" components of the result vector. 

This operation undoes the type conversion and packing performed by the 
PK2 instruction. See Table #1C. 



10 Table #1C 

tmp = ScalarLoad(opO) ; 

result. x = (fpl6) (RawBits (tmp) & OxFFFF); 
result. y = (fp!6) ( (RawBits (tmp) » 16) & OxFFFF) ; 
15 result. z = (fpl6) (RawBits (tmp) & OxFFFF); 

result. w = (fpl6) ( (RawBits (tmp) >> 16) & OxFFFF); 

The scalar operand may be loaded from a 32-bit temporary register. A 
fragment program may fail to load if any other register type is specified. 



20 



UP4: Unpack Four Signed 8-Bit Values 



The UP4 instruction unpacks four 8-bit signed values packed together in a 
32-bit scalar operand. The signed quantities are encoded where a bit pattern of all '0 ? 
25 bits corresponds to -128/127 and a pattern of all T bits corresponds to +127/127. 
The "x" component of the result vector is the converted value corresponding to the 8 
least significant bits of the operand; the "w" component corresponds to the 8 most 
significant bits. 



NVIDP069/P000051 V3.0 



- 12- 



This operation undoes the type conversion and packing performed by the 
PK4 instruction. See Table #1D. 



Table #1D 



tmp = ScalarLoad (opO) ; 

result. x = ( ( (RawBits (trap) >> 

result. y = (( (RawBits (tmp) >> 

result. z a (( (RawBits (tmp) >> 

result. w = (( (RawBits (tmp) >> 



0) Sc OxFF) - 128) / 127.0; 
8) & OxFF) - 128) / 127.0; 
16) & OxFF) - 128) / 127.0; 
24) & OxFF) - 128) / 127.0; 



The scalar operand may be loaded from a 32-bit temporary register. A 
fragment program may fail to load if any other register type is specified. 

More information on various programmable operations will be set forth 
hereinafter in greater detail. 

It should be noted that the output of the programmable operations may 
include any desired values that may be used for graphics processing. For example, 
the output of the programmable operations may include color values associated with 
a fragment. Such output of the programmable operations may also include depth 
values associated with a fragment. 



As another option, the fragment data maybe operated upon in a form which 
includes four-component vectors in a floating point representation for reasons that 
will soon become apparent. In particular, the present technique may define a 
programming model including a 4-component vector instruction set, 16- and 32-bit 
floating-point data types, and a relatively large set of temporary registers. 
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In still yet another embodiment, the programmable operations may be 
performed utilizing register combiners (i.e., NV_register_combiners extension) 
and/or in the context of multi-texturing (i.e. ARBjnultitexture extension). 

5 An exemplary method in which operation 204 is executed will be set forth in 

greater detail during reference to Figure 3. 

If, on the other hand, it is determined in decision 202 that the graphics 
pipeline is not operating in the programmable mode, standard graphics application 
10 program interface (API) operations are performed on the fragment data in order to 
generate output. Note operation 206. 

As an option, the standard graphics application program interface may 
include OpenGL® or any other desired graphics application program interface. 
1 5 Further, the standard graphics application program interface operations may be 

selected from the group consisting of texturing operations, color sum operations, fog 
operations, among others. 

Figure 3 illustrates a method 300 for programmable processing of fragment 
20 data in a computer graphics pipeline, in accordance with operation 204 of Figure 2. 
It should be noted, however, that the present method 300 may be carried out 
independent of the method 200 of Figure 2. 

As shown, fragment data is received which is selected from the group 
25 consisting of constant registers, color values and texture coordinates associated with 
a fragment. Note operation 302. Next, a current instruction of a fragment program 
is identified in operation 304. This may be accomplished utilizing a pointer or the 
like. 



NVIDP069/P000051 V3.0 



- 14- 



Subsequently, it is determined in decision 306 as to whether the identified 
instruction is a texture instruction. If so, texture data is retrieved utilizing texture 
coordinates in accordance with the fragment program. See operation 308. 
Thereafter, a condition code is evaluated, as will be set forth in greater detail during 
5 reference to operation 316. 

In a similar manner, it is determined in decision 310 as to whether the 
identified instruction is a mathematical instruction. If so, mathematical 
computations are performed involving the fragment data in accordance with the 
10 fragment program, as indicated in operation 312. Thereafter, a condition code is 
evaluated, as will be set forth in greater detail during reference to operation 316. 

Similarly, it is determined in decision 313 as to whether the identified 
instruction is a packing or unpacking instruction. If so, a packing or unpacking 
1 5 operation is performed involving the fragment data in accordance with the fragment 
program, as indicated in operation 313a. Thereafter, a condition code is evaluated, 
as will be set forth in greater detail during reference to operation 316. 



Next, it is determined in decision 314 as to whether the identified instruction 
M> 20 is a kill instruction. If so, a condition code is evaluated in operation 316. More 
information regarding such condition code will be set forth hereinafter in greater 
detail. If the condition code is evaluated to be TRUE, the fragment is killed and the 
program is terminated. Note operation 320. If, however, the condition code is 
evaluated to be FALSE, other "special" instruction types are searched and executed. 
25 Note operation 322. 

It is then determined in decision 324 as to whether the current instruction is 
the last instruction of the fragment program. If not, the various operations are 
repeated using the next instruction. If so, however, at least one of color values and 
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depth values are outputted based on the texture data, the mathematical computations, 
etc. Note operation 326. It should be noted that the floating-point color values 
outputted may actually have nothing to do with color, per-se. They could be, for 
example, normals (for future lighting operations), distances, or any other number of 
quantities. 

The present technique may, in one embodiment, take the form of an 
extension that provides a mechanism for defining fragment program instruction 
sequences for application-defined fragment programs. When in a fragment program 
mode, a fragment program may be executed each time a fragment is produced by 
rasterization. The inputs for the program may be a set of constant registers and the 
attributes (e.g. colors, texture coordinates) associated with the fragment. Further, a 
fragment program may perform texture lookups using arbitrary texture coordinates 
and mathematical computations. The results of a fragment program are new color 
and depth values for the fragment. Again, it should be noted that the floating-point 
color values outputted may actually have nothing to do with color, per-se. They 
could be, for example, normals (for future lighting operations), distances, or any 
other number of quantities. 

The present fragment program execution environment may be designed for 
efficient hardware implementation and to support a wide variety of programs. By 
design, the existing operations defined by existing OpenGL® per-fragment 
computation extensions can be implemented using the present model. 

More information regarding programmable fragment processing may be 
found by reference to a co-pending application entitled "SYSTEM, METHOD AND 
COMPUTER PROGRAM PRODUCT FOR PROGRAMMABLE FRAGMENT 
PROCESSING IN A GRAPHICS PIPELINE" filed concurrently herewith by the 
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same inventors under attorney docket number NVIDP067/P000049, and which is 
incorporated herein by reference in its entirety. 

Figure 4 illustrates a method 400 for buffering data in a computer graphics 
pipeline. Such method 400 may be carried out in the form of an extension or integral 
component of any desired application program interface. Of course, the present 
technique may be implemented in any desired manner in an architecture such as that 
shown in Figure 1 or in any other desired context. 

Further, the present embodiment may optionally build upon the foregoing 
fragment programmability to provide a framebuffer and texture format that allows 
fragment programs to read and write unconstrained floating point data. Of course, it 
should be noted that the present embodiment may be employed in any desired 
environmental context. For example, this technique may be carried out in any 
desired graphics sub-system. 

Initially, in operation 402, graphics floating point data are operated upon in a 
graphics pipeline. Such operations may include texturing operations, color sum 
operations, fog operations, or any other operation that contributes to or facilitates 
graphics processing. Such operations may or may not be associated with the 
aforementioned fragment program. 

During such operation 404, graphics floating point data may be produced. 
This may be accomplished by reading the same from a buffer (e.g. texture maps) in 
a graphics pipeline, generating the same with a rasterizer, or any other desired 
method. It should be noted that an order of operations 402 and 404 may be 
interchangeable, as with the remaining operations. 
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As an option, the graphics floating point data may include fragment data, 
color data, depth data, etc. Such fragment data may be received from a rasterizer or 
any other desired source. Of course, the graphics floating point data may include 
any data in the graphics pipeline that is in a floating point form. Further, some of 
such data may be fixed-point data that is optionally converted to floating-point. For 
example, interpolated RGB A colors (e.g., f[COL0] in fragment programs) maybe 
initially generated as fixed-point data. 

Next, the graphics floating point data is stored to the buffer in the graphics 
pipeline. See operation 406. 

In one embodiment, the graphics floating point data may be read and stored 
in an undamped format for increasing a parameter selected from the group 
consisting of a precision and a range of the graphics floating point data. Further, the 
graphics floating point data may be only constrained by an underlying data type. 

In another embodiment, the buffer may serve as a texture map. More details 
regarding such use will be set forth hereinafter in greater detail. 

As an option, the method 400 may be used in the context of multi-pass 
rendering in a computer graphics pipeline. See decision 408. During use, the 
foregoing operations 402-406 may be repeated during additional rendering passes 
per the desires of the user. More information on such embodiment will be set forth 
hereinafter in greater detail. 

For more information on multi-pass rendering, reference may be made to a 
patent application entitled "SYSTEM, METHOD AND ARTICLE OF 
MANUFACTURE FOR SHADOW MAPPING" which was filed 12/05/00 under 
serial number 09/730,639, and which is incorporated herein by reference. 
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As an option, the operating may include deferred shading. More information 
on such embodiment will be set forth hereinafter in greater detail. 

The present embodiment may thus provide a general computational model 
that supports floating-point numbers constrained only by the precision of the 
underlying data types. 

To enhance the extended range and precision available through fragment 
programs, the present embodiment provides floating-point RGBA color buffers to 
replace conventional fixed-point RGBA color buffers. It should be noted that the 
floating-point RGBA color buffers can (and often will) be used to store non-color 
data. A floating-point RGBA color buffer consists of one to four floating-point 
components stored in the 16- or 32-bit floating-point formats (fpl6 or fp32) which 
may be defined by a fragment program such as NV_fragment_program. Of course, 
formats other than 16- and 32-bit floating point are clearly possible. 

A floating-point color buffer can replace the conventional fixed-point color 
buffer. In this case, the results of fragment programs, written to the "x", "y", rf z", and 
"w" components of COLR/COLH output registers, may written directly to the color 
buffer without any scaling, clamping, or other modification. Certain per-fragment 
operations may be bypassed when rendering to floating-point color buffers. 

A floating-point color buffer can also be used as a texture map, either by 
using conventional Texlmage calls or by using previous rendering results via an 
extension such as the ARB_render_texture extension. 

The present embodiment has many uses. Some exemplary possible uses will 
now be set forth. 
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(1) Multi-pass algorithms with arbitrary intermediate results that don't have to 
be artificially forced to the range [0,1]. In addition, intermediate results can be 
accumulated without having to worry about [0,1] clamping. 

5 

(2) Deferred shading algorithms where an expensive fragment program is 
executed only after depth testing is fully complete. Instead, a simple program is 
executed, which stores the parameters necessary to produce a final result. After the 
entire scene is rendered, a second pass is executed over the entire frame buffer to 

1 0 execute the complex fragment program using the results written to the floating-point 
color buffer in the first pass. This may save the cost of executing complex fragment 
programs on fragments that may not necessarily appear in the final image. 



(3) Use of texture maps to evaluate functions with arbitrary ranges. 
1 5 Arbitrary continuous functions with a bounded domain could be approximated using 
a texture map holding sample results and piecewise linear interpolation. 

More information will now be set forth regarding an exemplary embodiment 
of the foregoing technique. The following description should be reviewed for 
\a 20 illustrative purposes only, and should not be construed as limiting in any manner. 

The foregoing principles may be applied in any desired extension and in any desired 
context. 

The following description is set forth in the context of OpenGL® which is 
25 commonly known to those of ordinary skill. More particularly, the following 

information is set forth in the context of the OpenGL® Specification Version 1.3, 
which is incorporated herein by reference in its entirety. It should be noted that, in 
the present description, OpenGL® API commands and tokens are prefixed by "gl" 
and "GL_, M respectively. Also, OpenGL® extension commands and tokens for 
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extensions provided by NVIDIA® Corporation are, by convention, suffixed by "NV" 
or "_NV," respectively. When the context is clear, such prefixes and suffices are 
dropped for brevity and clarity. 

Various exemplary tokens associated with the present embodiment will now 
be set forth in Table #1E. 

Table #1E 

Accepted by the < int e ma 1 forma t> parameter of TexImage3D, 
TexImage2D, 

TexImagelD, CopyTexImage2D / and CopyTexImage ID : 

F L 0 AT_R_NV 0x88 80 

FLOAT_RG_NV 0x88 81 

FLOAT_RGB JSTV 0x8 882 

FLOAT_RGBA_NV 0x8 8 83 

FLOAT_R16_NV 0x8884 

FLOAT_R32JSTV 0x8885 

FLOAT_RG16_NV 0x8886 

FLOAT_RG32_NV 0x8887 

FLOAT_RGB16_NV 0x8 88 8 

FLOAT_RGB32_NV 0x888 9 

FLOAT_RGBA16_NV 0x8 8 8A 

FLOAT_RGBA3 2_NV 0x8 8 8B 

Accepted by the <pname> parameter of GetBooleanv, 
Getlntegerv, GetFloatv, 
and GetDoulDlev: 

TEXTURE_FLOAT_COMPONENTS_NV 0x8 8 8 C 

FLOAT CLEAR COLOR VALUE NV 0x8 8 8D 
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FLOAT_RGBA_MODE_NV 0x8 8 8E 

Accepted in the <piAt tributes > array of 
wglGetPixelFormatAttribivARB and 

wglGetPixelFormatAttribfvARB and in the <piAttribIList> 

and 

<pfAttribFList> arrays of wglChoosePixelFormatARB 
WGL_FL0AT_C0MP0NENTS_NV 

WGL_B IND_TO_TEXTURE_RE CTANGLE_FLO AT_R_NV 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RG_NV 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RGB_NV 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RGBA_NV 
WGL_TEXTURE_FLOAT_R_NV 
WGL_TEXTURE_FLOAT_RG_NV 
WGL_TEXTURE_FLOAT_RGB_NV 
WGLJTEXTURE_FLOAT_RGBA_NV 

Final Conversion of DrawPixels Data 

For RGBA components, if the destination of the operation is a fixed-point 
color buffer, each element is clamped to [0,1] and the resulting values are converted 
to fixed-point in a well known manner. Otherwise, elements are not necessarily 
modified. More information on this topic, as it pertains to fixed-point color buffers, 
that is well known to those of ordinary skill may be found in section 3.6.4 of the 
OpenGL 1.3 Specification. 

Texture Image Specification 

The selected groups are processed exactly as for DrawPixels stopping just 
before final conversion. For textures with fixed-point RGBA internal formats, each 
R, G, B, A component is clamped to [0,1]. 



0x63F0 
0x63Fl 
0x63F2 
0x63F3 
0x6 3 F4 
0x63F5 
0X63F6 
0X63F7 
0x63F8 
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Components are selected from the resulting pixel groups to obtain a texture 
with the base internal format specified by (or derived from) <internalformat>. Table 
#2 summarizes the mapping of pixel group values to texture components. 

Specifying a value of <format> incompatible with <internalformat> produces 
the error INVALDD OPERATION. A pixel format and texture internal format are 
compatible if the pixel format can generate a pixel group of the type listed in the 
"Pixel Group Type" column of Table #2 in the row corresponding to the base internal 
format. 

Textures with a base internal format of FLOAT_R_NV> FLOAT_RG_NV, 
FLOATRGBNV, and FLOAT RGBA NV are known as floating-point textures. 
Such textures take the form of RGB A floating-point data, but the data contained may 
not have anything to do with color. In one embodiment, floating point textures may 
be supported only for the TEXTURE_RECTANGLE_NV target. Specifying an 
floating-point texture with any other target may produce an 
INVALIDOPERATION error. 

Table 2 



Base Internal 
Format 


Pixel 

Group Type 


Component 
Values 


Internal 
Components 


ALPHA 


RGBA 


A 


A 


LUMINANCE 


RGBA 


R 


L 


LUMINANCE_ALPHA 


RGBA 


R, A 


L,A 


INTENSITY 


RGBA 


R 


I 


RGB 


RGBA 


R,G,B 


R, G, B 


RGBA 


RGBA 


R,G,B,A 


R,G,B,A 


* COLOR_INDEX 


CI 


CI 


CI 


* DEPTH_COMPONENT 


DEPTH 


DEPTH 


DEPTH 


* HILO_NV 


HILO 


HI,LO 


HI,LO 


* DSDT_NV 


TEXOFF 


DS,DT 


DS, DT 


* DSDT_MAG_NV 


TEXOFF 


DS,DT,MAG 


DS , DT , MAG 
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DSDT_MAG_INTENSITY_NV 


TEXOFF 








or RGBA 


DS , DT , MAG , VIB 


DS,DT,MAG,I 


FLOAT_R_NV 


RGBA 


R 


R (float) 


FLOAT_RG_NV 


RGBA 


R,G 


R, G (float) 


FLOAT_RGB_NV 


RGBA 


R, G, B 


R, G, B (float) 


FLOAT_RGBA_NV 


RGBA 


R,G,B,A 


R, G, B, A (float) 



Conversion from pixel groups to internal texture components. "Pixel Group Type" 
defines the type of pixel group required for the specified internal format. All 
internal components are stored as unsigned- fixed point numbers, except for DS/DT 
(signed fixed-point numbers) and floating-point R,G,B,A (signed floating-point 
numbers) . Texture components -> R, G, B, A, L, and I. Texture components -> HI, LO, 
DS, DT, and MAG. 

* - indicates formats found in other extension specs: COLOR_INDEX in EXT_paletted 
texture; DEPTH_COMPONENT in SGIX_depth_texture; and HILO_NV, DSDT_NV, DSDT_MAG_NV, 
D SDT_MAG_INTENS I T Y_NV in NV_texture_shader . 

It should be noted that this table may be respecfied with any extensions 
relevant to texture formats supported by a particular environment. For example, four 
base internal formats may be added. 

The internal component resolution is the number of bits allocated to each 
component in a texture image. If internal format is specified as a base internal 
format (as listed in Table #2), the GL stores the resulting texture with internal 
component resolutions of its own choosing. If a sized internal format is specified, the 
memory allocation per texture component is assigned by the GL to match the 
allocations listed in Table #3 as closely as possible. 

Table 3 

Sized Base 

Int. Format Int. Format Component Name / Type-Size 

ALPHA4 ALPHA A/U4 

ALPHA8 ALPHA A/U8 
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ALPHA12 


ALPHA 


ALPHA16 


ALPHA 


LUMINANCE 4 


LUMINANCE 


LUMINANCE 8 


LUMINANCE 


LUMINANCE 12 


LUMINANCE 


LUMINANCE 16 


LUMINANCE 


LUMINANCE4_ALPHA4 


LUMINANCE_ALPHA 


LUMINANCE 6__ALPHA2 


LUMINANCE_ALPHA 


LUMINANCE 8_ALPHA8 


LUMINANCE_ALPHA 


LUMINANCE12 ALPHA4 


LUMINANCE ALPHA 


LUMINANCE12_ALPHA12 


LUMINANCE_ALPHA 


LUM I NANC E 1 6 _AL PHA1 6 


LUMINANCE_ALPHA 


INTENSITY4 


INTENSITY 


INTENSITY8 


INTENSITY 


INTENSITY12 


INTENSITY 


INTENSITY16 


INTENSITY 


R3_G3_B2 


RGB 


RGB 4 


RGB 


RGB5 


RGB 


RGB 8 


RGB 


RGB10 


RGB 


RGB 12 


RGB 


RGB16 


RGB 


RGBA2 


RGBA 


RGBA4 


RGBA 


RGB 5 Al 


RGBA 


RGBA8 


RGBA 


RGB 10 A2 


RGBA 


RGBA12 


RGBA 


RGBA16 


RGBA 


COLOR_INDEXl_EXT 


COLOR_INDEX 


COLOR INDEX2 EXT 


COLOR INDEX 


COLOR INDEX4 EXT 


COLOR INDEX 


COLOR INDEX8 EXT 


COLOR INDEX 


COLOR_INDEXl 6_EXT 


COLOR_INDEX 


DEPTH_COMPONENT16_SGIX 


DEPTHJTOMPONENT 


DEPTH COMPONENT 2 4 SGIX 


DEPTH COMPONENT 


DEPTH_COMPONENT32_SGIX 


DE PTH_COMPONENT 


HIL016_NV 


HILO 


S IGNED_HI LO 1 6_NV 


HILO 


SIGNED_RGBA8_NV 


RGBA 


SIGNED_RGB8_ 




UNSIGNED_ALPHA8_NV 


RGBA 


S I GN ED_RGB 8 _NV 


RGB 



A/U12 

A/U16 

L/U4 

L/U8 

L/U12 

L/U16 

A/U4 L/U4 

A/U2 L/U6 

A/U8 L/U8 

A/U4 L/U12 

A/U12 L/U12 

A/U16 L/U16 

I/U4 

I/U8 

I/U12 

I/U16 



R/U3 


G/U3 


B/U2 




R/U4 


G/U4 


B/U4 




R/U5 


G/U5 


B/U5 




R/U8 


G/U8 


B/U8 




R/U10 


G/U10 


B/10 




R/U12 


G/U12 


B/U12 




R/U16 


G/U16 


B/U16 




R/U2 


G/U2 


B/U2 


A/U2 


R/U4 


G/U4 


B/U4 


A/U4 


R/U5 


G/U5 


B/U5 


A/Ul 


R/U8 


G/U8 


B/U8 


A/U8 


R/U10 


G/U10 


B/U10 


A/U2 


R/U12 


G/U12 


B/U12 


A/U12 


R/U16 


G/U16 


B/U16 


A/U16 



CI/U1 

CI/U2 

CI/U4 

CI/U8 

CI/U16 

Z/U16 

Z/U24 

Z/U32 

HI/U16 LO/U16 
HI/S16 LO/S16 
R/S8 G/S8 B/S8 A/S8 

R/S8 G/S8 B/S8 A/U8 
R/S8 G/S8 B/S8 
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* S I GNED_LUM I NANC E 8 _NV LUMINANCE L/S8 

* SIGNED LUMINANCE 8 



ALPHA8_NV 


LUMINANCE_ALPHA 


L/S8 


A/S8 




S I GNED_AL PHA 8 _NV 


ALPHA 


A/S8 






S I GNED_INTENS I TY8_NV 


INTENSITY 


I/S8 






DSDT8_NV 


DSDTJTV 


DS/S8 


DT/S8 




DSDT8_MAG8_NV 


DSD T_MAG_NV 


DS/S8 


DT/S8 


MAG/U8 


DSDT8_MAG8_ 


DSDT_MAG_ 








INT ENS ITY8_NV 


INTENS I T Y_NV 


DS/S8 


DT/S8 


MAG/U8 


FL0AT_R16_NV 


FLOAT_R_NV 


R/F16 






FLOAT_R32_NV 


FLOAT_R_NV 


R/F32 






F LOAT_RG 1 6_NV 


FLOAT_RG_NV 


R/F16 


G/F16 




FLOAT_RG32_NV 


FLOAT_RG_NV 


R/F32 


G/F32 




FL0AT_RGB16_NV 


FLOAT_RGB_NV 


R/F16 


G/F16 


B/F16 


F LOAT_RGB 3 2 _NV 


FLOAT_RGB_NV 


R/F32 


G/F32 


B/F32 


FL0AT_RGBA16_NV 


FLOAT_RGBA_NV 


R/F16 


G/F16 


B/F16 


FL0AT_RGBA3 2_NV 


FLOAT_RGBA_NV 


R/F32 


G/F32 


B/F32 



Sized Internal Formats. Describes the correspondence of sized internal formats to 
base internal formats, and desired component resolutions. Component resolution 
descriptions are of the form n <NAME>/<TYPE><SIZE> u , where NAME specifies the 
component name in Table #2, TYPE is "U" for unsigned fixed-point, "S" for signed 
fixed-point, and "F" for unsigned floating-point. <SIZE> is the number of requested 
bits per component. 



* - indicates formats found in other extension specs: COLOR_INDEX in 
EXT_paletted texture; DEPTH_COMPONENT in SGIX_depth_texture ; and HILO_NV, DSDT_NV, 
DSDT_MAG_NV, D SDT_MAG_I NT ENS I T Y_NV in NV_texture_shader . 



It should be noted that this table may be respecfied with any extensions 
relevant to sized texture internal formats supported by a particular environment. For 
example, eight sized internal formats may be added. More information on this topic 
that is well known to those of ordinary skill may be found in section 3.8.1 of the 
OpenGL 1.3 Specification and the extension specifications for the extensions listed 
above. 



Texture Minification 



NVIDP069/P000051 V3.0 



-26- 



Floating-point textures (those with a base internal format of FLOATRJNV, 
FLOAT_RG_NV, FLOAT_RGB_NV, or FLOATJRGB A_NV) do not necessarily 
support texture filters other than NEAREST. For such textures, NEAREST filtering 
is applied regardless of the setting of TEXTURE JVIINFILTER. More information 
5 on this topic that is well known to those of ordinary skill may be found in section 
3.8.7 of the OpenGL 1.3 Specification. 

Texture Magnification 

10 Floating-point textures (those with a base internal format of FLO AT_R_NV, 

FLOAT_RG_NV, FLOATRGBNV, or FLOAT_RGBA_NV) do not necessarily 
support texture filters other than NEAREST. For such textures, NEAREST filtering 
is applied regardless of the setting of TEXTURE JVIAGFELTER. More information 
on this topic that is well known to those of ordinary skill may be found in section 

15 3.8.8 of the OpenGL 1 .3 Specification. 

Texture Environments and Texture Functions 

If the base internal format is HILO_NV, DSDT NV, DSDT_MAG_NV, 
20 DSDT_MAGJNTENSITY_NV, FLOATJMNV, FLOATRGNV, 

FLOAT RGBJNV, or FLOAT_RGB A NV, means to combine texture lookup 
results with the current fragment color are not necessarily supported using 
conventional OpenGL texture functions. In one embodiment where such textures are 
unsupported, the corresponding texture function is NONE (Cv = Cf, Av = Af), and it 
25 is as though texture mapping were disabled for that texture unit. It may even be 

possible to define useful conventional behavior. More information on this topic that 
is well known to those of ordinary skill may be found in section 3.8.13 of the 
OpenGL 1.3 Specification. 



NVIDP069/P000051 V3.0 



-27- 



AntialiasinR Application 

If antialiasing is enabled for the primitive from which a rasterized fragment 
was produced, then the computed coverage value may be applied to the fragment. In 
RGBA mode with fixed-point frame buffers, the value is multiplied by the 
fragment's alpha (A) value to yield a final alpha value. In RGBA mode with 
floating-point frame buffers, the coverage value may simply be discarded in some 
embodiments. In color index mode, the value is used to set the low order bits of the 
color index value. More information on this topic that is well known to those of 
ordinary skill maybe found in section 3.1 1 of the OpenGL 1.3 Specification. 

Per-Fragment Operations and the Frame Buffer 

The GL provides three types of color buffers: color index, fixed-point 
RGBA, or floating-point RGBA. Color index buffers consist of unsigned integer 
color indices. Fixed-point RGBA buffers consist of R, G, B, and optionally, A 
unsigned integer values. Floating-point RGBA buffers consist of R, and optionally, 
G, B, and A floating-point component values, which may correspond to the X, Y, Z, 
and W outputs, respectively, of a fragment program. The number of bitplanes in 
each of the color buffers, the depth buffer, the stencil buffer, and the accumulation 
buffer is fixed and window dependent. If an accumulation buffer is provided, it may 
have at least as many bitplanes per R, G, and B color component as do the color 
buffers. More information on this topic that is well known to those of ordinary skill 
may be found in Chapter 4 of the OpenGL 1.3 Specification. 

Multisample Fragment Operations 

Optionally, this step applies only for fixed-point RGBA color buffers. 
Otherwise, proceed to the next step. More information on this topic that is well 
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known to those of ordinary skill may be found in section 4. 1 .3 of the OpenGL 1 .3 
Specification. Of course, the present step may optionally be applied to floating-point 
RGBA color buffers. 

Alpha Test 

This step applies only for fixed-point RGBA color buffers. Otherwise, 
proceed to the next step. More information on this topic that is well known to those 
of ordinary skill maybe found in section 4.1.4 of the OpenGL 1.3 Specification. Of 
course, the present step may optionally be applied to floating-point RGBA color 
buffers. 

Blending 

Blending combines the incoming fragment's R, G, B, and A values with the 
R, G, B, and A values stored in the framebuffer at the incoming fragment's (xw; yw) 
location. This blending is dependent on the incoming fragment's alpha value and 
that of the corresponding currently stored pixel. Blending applies only for fixed- 
point RGBA color buffers; otherwise, it is bypassed. More information on this topic 
that is well known to those of ordinary skill may be found in section 4.1.7 of the 
OpenGL 1.3 Specification. Of course, the present step may optionally be applied to 
floating-point RGBA color buffers. 

Dithering 

Dithering selects between two color values or indices. Dithering does not 
necessarily apply to floating-point RGBA color buffers. More information on this 
topic that is well known to those of ordinary skill may be found in section 4.1.8 of 
the OpenGL 1.3 Specification. 
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Logical Operation 

A logical operation is applied between the incoming fragment's color or index 
values and the color or index values stored at the corresponding location in the frame 
buffer. Logical operations do not necessarily apply to floating-point color buffers. 
More information on this topic that is well known to those of ordinary skill may be 
found in section 4.1.9 of the OpenGL 1.3 Specification. 

Additional Multisample Fragment Operations 

For fixed-point RGBA color buffers, after all operations have been completed 
on the multisample buffer. For floating-point RGBA color buffers, the color buffer 
is not necessarily modified. More information on this topic that is well known to 
those of ordinary skill maybe found in section 4.1.10 of the OpenGL 1.3 
Specification. 

Clearing the Buffers 

The GL provides a means for setting portions of every pixel in a particular 
buffer to the same value. The argument to 

void ClearColor(float r, float g, float b, float a); 

sets the clear value for RGBA color buffers. When a fixed-point color buffer is 
cleared, the effective clear color is derived by clamping each component to [0,1] and 
converting to fixed-point according to the rules well known to those of ordinary skill. 
When a floating-point color buffer is cleared, the components of the clear value are 
used directly without being clamped. More information on this topic that is well 



NVIDP069/P000051 V3.0 



-30- 



known to those of ordinary skill may be found in section 4.2.3 of the OpenGL 1.3 
Specification. 



10 



20 



The Accumulation Buffer 

If there is no accumulation buffer, or if color buffer is not fixed-point RGB A, 
Accum may generate the error INVALID OPERATION. More information on this 
topic that is well known to those of ordinary skill may be found in section 4.2.4 of 
the OpenGL 1.3 Specification. 

Reading Pixels/ Conversion of RGB A Values 



5 This step applies only if the GL is in RGB A mode, and then only if format is 

p neither STENCIL INDEX nor DEPTH COMPONENT. The R, G, B, and A values 

1 5 form a group of elements. If the color buffer has fixed-point format, each element is 

" J taken to be a fixed-point value in [0,1] with m bits, where m is the number of bits in 

si 

M the corresponding color component of the selected buffer. More information on this 

topic that is well known to those of ordinary skill may be found in section 4.3.2 of 
the OpenGL 1.3 Specification. 



Final Conversion of ReadPixels Data 



For an RGBA color, components are clamped depending on the data type of 
the buffer being read. For fixed-point buffers, each component is clamped to [0.1]. 
25 For floating-point buffers, if <type> is not FLOAT or HALFJFLOATJNTV, each 

component is clamped to [0,1] if <type> is unsigned or [-1,1] if <type> is signed and 
then converted. More information on this topic that is well known to those of 
ordinary skill may be found in section 4.3.2 of the OpenGL 1 .3 Specification. 
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Texture Queries 

Table #4 illustrates texture, table, and filter return values. Ri, Gi, Bi, Ai, Li, 
and Ii are components of the internal format that are assigned to pixel values R, G, B, 
and A. If a requested pixel value is not present in the internal format, the specified 
constant value is used. More information on this topic that is well known to those of 
ordinary skill maybe found in section 6.1.4 of the OpenGL 1.3 Specification. 



Table #4 



Base Internal Format 



WGL Subsystem 



FLOAT_R_NV R 0 0 0 

FLOAT_RG_NV R G 0 0 

FLOAT_RGB_NV R G B 0 

FLOAT RGBA NV R G B A 



Table #5 illustrates possible modifications to WGL (OpenGL on Microsoft 
Windows®) subsystem, as extended by the ARB_pixel_format and 
ARB__render__texture extensions, to accommodate the present invention. 



Table #5 



Modify/add to the description of <piAttributes> in 
wglGet Pixel Format At tribivARB and <pf Attributes> in wglGet Pixel Format At tribfvARB : 

WGL_FLOAT_COMPONENTS_NV 

True if the R, G, B, and A components of each color buffer are 
represented as (undamped) floating-point numbers. 
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WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_R_NV 

WGL__BIND__TO_TEXTURE_RECTANGLE_FLOAT_RG__NV 

WG L_B IND_T 0_T EXTURE_RE CTANGL E_FLOAT_RGB__NV 

WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RGBA_NV 

True if the pixel format describes a floating-point color that can be 
bound to a texture rectangle with internal formats of FLOAT_R_NV, 
FLOAT_RG_NV, FLOAT_RGB_NV , or FLOAT_RGBA_NV , respectively. Currently 
only pbuffers can be bound as textures so this attribute may only be 
TRUE if WGL_DRAW_TO_PBUFFER is also TRUE. Additionally, 

floating-point color buffers can not necessarily be bound to texture targets 
other than TEXTURE__RECTANGLE_jDJV . 

Add new table entries for pixel format attribute matching in 
wglChoosePixelFormatARB . 

Attribute Type Match Criteria 



WGL_FLOAT_COMPONENTS_NV boolean exact 

WGL_BIND_TO_TEXTURE_ boolean exact 

RECTANGLE_FLOAT_R_NV 
WGL_BIND_TO_TEXTURE_ boolean exact 

RECTANGLE_FLOAT_RG_NV 
WGL_BIND_TO_TEXTURE_ boolean exact 

RECTANGLE_FLOAT_RGB_NV 
WGL__B I ND_TO__TEXTURE_ boolean exact 

RECTANGLE_FLOAT_RGBA_NV 

(In the wglCreatePbuf ferARB section, modify the attribute list) 
WGL_TEXTURE_FORMAT_ARB 

This attribute indicates the base internal format of the texture that will be 
created when a color buffer of a pbuffer is bound to a texture map. It can 
be set to WGL_TEXTURE_RGB_ARB (indicating an internal format of RGB), 
WGL_TEXTURE_RGBA_ARB (indicating a base internal format of RGB A) , 
WGL_TEXTURE_FLOAT_R_NV (indicating a base internal format of FL OAT_R_MV ) , 
WGL_TEXTURE_FLOAT_RGJW (indicating a base internal format of FLOAT_RG_NV) , 
WGL_TEXTURE_FLOAT_RGB_NV (indicating a base internal format of FL0AT_RGB__3STV) , 
WGL_TEXTURE_FLOAT_RGBA_NV (indicating a base internal format of 
FLOAT_RGBA_NV) , orWGL__NO__TEXTURE_ARB . The default value is 
WGL_NO_TEXTURE_ARB . 

(In the wglCreatePbuf ferARB section, modify the discussion of what happens 
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to the depth/stencil/accum buffers when switching between mipmap levels or 
cube map faces . ) 

For pbuffers with a texture format of WGL_TEXTURE_jRGB_ARB , 
WGL_TEXTURE_RGBA_AR3, WGLJTEXTURE_FLOAT_R_NV , WGL__TEXTURE_FLOAT_RG_NV , 
WGL_TEXTURE_FLOAT_RGBJJV, or WGL_TEXTURE_FLOAT_RGBA_JNV, there will be a 
separate set of color buffers for each mipmap level and cube map face in the 
pbuffer. Otherwise, the WGL implementation is free to share a single set of 
color, auxiliary, and accumulation buffers between levels or faces. 

For pbuffers with a texture format of 
WGL__TEXTURE_DE PTH_COMPONENT__NV , 

there may be a separate depth buffer for each mipmap level and cube map 
face. However, any stencil, accumulation, and color buffers may be shared 
between levels or faces. Therefore, the contents of the stencil, 
accumulation, and color buffers are undefined after switching between 
mipmap levels or cube map faces. 

(In the wglCreatePbuf f erARB section, modify the error list) 

ERROR__INVAL I D_D AT A WGL_TEXTURE_FORMAT_ARB is 

WGL_TEXTURE_FLOAT_R_NV , 
WGL JTEXTURE_FLOAT_RG_NV , 
WGL_TEXTURE_FLOAT_RGB_NV, or 
WGL_TEXTURE_FLOAT_RGBA_NV, and 
WGL_TEXTURE_TARGET_ARB is not 
WGL_TEXTURE_RE CT ANGLE_NV . 

ERROR_INVALI DJDATA WGL_TEXTURE_FORMAT_ARB is 

WGL_TEXTURE_FLOAT_R_NV , 
WGL_TEXTURE_TARGET_ARB is 
WGL_TEXTURE_RECTANGLE_NV, and the 
WGL_BIND_TO_TEXTURE_RECTANGLE__FLOAT_R_NV 
attribute is not necessarily set in the pixel format . 

ERROR__ INVAL I D_D AT A WGL_TEXTURE_FORMAT_ARB is 

WGL_TEXTURE_FLOAT_RG_NV , 
WGL_TEXTURE_TARGET_ARB is 
WGL_TEXTURE_RECTANGLE_NV, and the 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RG_NV 
attribute is not necessarily set in the pixel format . 

ERROR INVALID DATA WGL TEXTURE FORMAT ARB is 
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WGL_TEXTURE_FLOAT_RGB_NV , 

WGL__TEXTURE_TARGET_ARB is 

WGL_TEXTURE_RECTANGLE_NV , and the 

WGL_B I ND_TO_T EXT URE_RE CT ANGL E_FLOAT_RGB_NV 

attribute is not necessarily set in the pixel format. 



ERROR INVALID DATA 



WGL_TEXTURE_FORMAT_ARB is 

WGL_TEXTURE_FLOAT_RGBA_NV , 

WGL_TEXTURE_TARGET_ARB is 

WGL_TEXTURE_RECTANGLE__NV , and the 

WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RGBA_NV 

attribute is not necessarily set in the pixel format. 



Modify wglBindTexImageARB : 

The pbuffer attribute WGL_TEXTURE_FORMAT_ARB determines the base 
internal format of the texture. The format- specific component sizes 
are also determined by pbuffer attributes as shown in the table below. 
The component sizes are dependent on the format of the texture. 



Component 



Size 



Format 



WGL RED BITS ARB 



WGL GREEN BITS ARB 



WGL BLUE BITS ARB 



WGL ALPHA BITS ARB 



WGL DEPTH BITS ARB 



RGB, RGBA, FLOAT_R, FLOATJRG, 

FLOAT_RGB , FLOAT_RGBA 

RGB, RGBA, FLOAT_R, FLOAT_RG, 

FLOAT_RGB, FLOAT_RGBA 

RGB, RGBA, FLOAT_R , FLOAT_RG, 

FLOAT_RGB, FLOAT_RGBA 

RGB, RGBA, FLOAT_R, FLOAT_RG, 

FLOAT_RGB, FLOAT_RGBA 

DEPTH COMPONENT 



Table #6 illustrates a plurality of errors that may be relevant in the context of 
the present embodiment. 

Table #6 

INVAL ID_0 P ERAT I ON may be generated by Begin, DrawPixels, 
Bitmap, CopyPixels, or a command that performs an explicit Begin if 
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the color buffer has a floating-point RGBA format and 
FRAGMENT_PROGRAM_NV is disabled, 

INVALID_0PERATI0N is generated by TexImage3D, TexImage2D, 
TexImagelD, TexSubImage3D, TexSubImage2D, or TexSublmagelD if the 
pixel group type corresponding to <format> is not compatible with 
the base internal format of the texture. 

INVALID_OPERATION may be generated by TexImage3D, TexImagelD, 
or CopyTexImagelD if the base internal format corresponding to 
<internalformat> is FLOATJMSTV, FLOAT_RG_NV, FLOAT_RGB_NV , or 
FLOAT_RGBA_NV. 

INVALID_OPERATION may be generated by TexImage2D or 
CopyTexImage2D if the base internal format corresponding to 
<internalf ormat> is FL0AT_R_NV , FLOAT_RG_NV, FL0AT_RGB_NV , or 
FLOAT_RGBA_NV and < target > is not TEXTURE_JRECTANGLE_NV . 

INVALID_OPERATION may be generated by Accum if the color 
buffer has a color index or floating-point RGBA format. 

ERROR__USTVAL I D__DATA may be generated by wglCreatePbuf f erARB if 
WGL_TEXTURE_FORMAT_ARB is WGLJTEXTURE_FLOAT_R_NV , 
GLJTEXTURE_FLOAT_RGJSrV, WGLJTEXTURE_FLOAT_RGBJW , or 
WGLJTEXTURE_FLOAT_RGBA_NV, and WGL__TEXTURE_TARGET_ARB is not 
WGL_TEXTURE_RECTANGLE JSTV . 

ERROR__INVAL ID__D ATA is generated by wglCreatePbuf f erARB if 
WGL__TEXTURE_FORMAT_ARB is WGL_TEXTURE_FLOAT_R^NV , 
WGL_TEXTURE_TARGET_ARB is WGL_TEXTURE_RECTANGLE_NV, and the 
WGL_BIND__TO_TEXTURE_RECTANGLE_FL,OAT_R_MV attribute is not set in the 
pixel format . 

ERROR_INVALID__DATA is generated by wglCreatePbuf f erARB if 
WGL_TEXTURE_FORMAT_ARB is WGL_TEXTURE_FLOAT_RG_NV , 
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WGL_TEXTURE_TARGET_ARB is WGL_TEXTURE_RECTANGLE_NV, and the 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RG_NV attribute is not set in 
the pixel format. 

ERROR_ I NVAL I D_D AT A is generated by wglCreatePbuf f erARB if 
WGL_TEXTURE_FORMAT_ARB is WGL_TEXTURE_FLOAT_RGB_NV , 
GL_TEXTURE_TARGET_ARB is WGLJTEXTURE_RECTANGLEJSTV, and the 
WGL_BIND_TO_TEXTURE_RECTANGLE_FLOAT_RGB_NV attribute is not set in 
the pixel format. 

ERROR_INVALID_DATA is generated by wglCreatePbuf f erARB if 
WGL_TEXTURE_FORMAT_ARB is WGL_TEXTURE_FLOAT_RGBA_NV , 
WGL_TEXTURE_TARGET_ARB is WGL_TEXTURE_RECTANGLE_NV r and the 
WGL_BIND_TO_TEXTURE_RECTAWGLE_FLOAT_RGBA_NV attribute is not set in 
the pixel format. 

Figure 5 illustrates new states 500 that may be relevant in the context of the 
present embodiment. More information on this that is well known to those of 
ordinary skill maybe found in section 6.2 of the OpenGL 1.3 Specification. 

Options and Issues 

The extension could create a separate non-RGBA pixel formats or simply 
extend existing RGB A formats. Since fragment programs generally build on RGB A 
semantics, it's cleaner to avoid creating a separate "XYZW" mode. There are several 
special semantics that may be added: clear color state is now not clamped, and 
ReadPixels may clamp to [0,1] only if the source data comes from fixed-point color 
buffers. 

It should be noted that fragment programs can be written that store data 
completely unrelated to color into a floating-point "RGBA" color buffer. 
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Floating-point color buffers may or may not be displayed. In one 
embodiment, floating-point color buffers can only be used as pbuffers (i.e. off-screen 
windows), to avoid the expense of building floating-point display engine logic. 

Various things may happen when rendering to a floating-point color buffer if 
fragment program mode is disabled, or when fragment program mode is enabled, but 
no program is loaded. Fragment programs may be required to use floating-point 
color buffers. An INVALID OPERATION error may be generated by any GL 
command that generates fragments if a fragment program extension such as 
FRAGMENT_PROGRAM_NV is disabled. The same behavior already exists in 
some embodiments for conventional frame buffers if 

FRAGMENT_PROGRAM_NV is enabled but the bound fragment program is 
invalid. 

Alpha test may or may not be supported with floating-point color buffers. If 
not, it is trivial to implement an alpha test in a fragment program using a KIL 
instruction, which requires no dedicated frame buffer logic. 

Blending may or may not be supported with floating-point color buffers. 
While blending would clearly be useful, full-precision floating-point blenders are 
expensive. In addition, a computational model more general than traditional 
blending (with its 1-x operations and clamping) is desirable. The traditional 
OpenGL blending model would not necessarily be the most suitable computational 
model for blend-enabled floating-point color buffers. 

An alternative to conventional blending (operating at a coarser granularity) is 
to (1) render a pass into the color buffer, (2) bind the color buffer as a texture 
rectangle using this extension and ARB_render_texture, (3) perform texture lookups 
in a fragment program using the TEX instruction with f[WPOS].xy as a 2D texture 
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coordinate, and (4) perform the necessary blending between the passes using the 
same fragment program. 

Accumulation buffers may or may not be provided for pixel formats with 
5 floating-point color buffers. If not, accumulation operations can be achieved by 
using multiple color buffers with fragment programs to perform the accumulation, 
which requires no dedicated frame buffer logic. 

Fragment program color results may or may not be converted to match the 
10 format of the frame buffer. Further, an error may or may not result. A situation of 
interest arises when one writes to o[COLR] but has a 16-bit floating-point frame 
buffer. Conversions can be performed simply in hardware, so no error semantics are 
required. This mechanism also allows the same programs to be shared between 
contexts with different pixel formats. 



Applications may be aware that PK2/PK4 results are preserved only if written 
to an appropriate-sized frame buffer. 

Floating-point color buffers may interact with multisampling in any desired 
20 manner. For normal color buffers, the multiple samples for each pixel may be 
required to be filtered down to a single color. Similar filtering on floating-point 
color buffers does not necessarily make sense. Further, there may or may not be a 
normal color buffer in this case. Floating-point buffers are specified to work with 
multisampling just like normal color buffers, except that no automatic resolution is 
25 performed. Still, this has its problems. For example, what would ReadPixels return? 
One option may be for an application to supersample (i.e., allocate a larger buffer) 
instead of multisample, but that has performance disadvantages. A second option 
may be to eat the memory and do a downsample if and only if necessary. A third 
option may be to specify "multisample-only" behavior. 
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Conventional RGBA antialiasing multiplies coverage by the alpha 
component of the fragment's color, with the assumption that alpha blending will be 
performed. Antialiasing may work with floating-point color buffers in various ways. 
It should be noted, however, that conventional antialiasing requires alpha blending, 
which may or may not work for floating-point color buffers. 

The semantics for DrawPixels may vary when using an floating-point color 
buffer. DrawPixels generates fragments like any other primitive. For floating-point 
color buffers, the components of the associated color are not necessarily clamped to 
[0, 1], as with conventional frame buffers. This ensures that one can save and restore 
floating-point color buffers using ReadPixels/DrawPixels. 

The semantics for ReadPixels may vary when using an floating-point color 
buffer. ReadPixels from a floating-point color buffer works like any other RGBA 
read, except that the final results are not necessarily clamped to the range [0, 1]. 
This ensures that one can save and restore floating-point color buffers using 
ReadPixels/DrawPixels. 

The semantics for CopyPixels may vary when using an floating-point color 
buffer. CopyPixels requires no special semantics, as it is equivalent to a slightly 
abbreviated ReadPixels followed by a DrawPixels. 

The semantics for Bitmap may also vary when using an floating-point color 
buffer. Bitmap generates fragments using the current raster attributes, which are 
then passed to fragment programs like any other fragments. 

Still yet, the semantics for Clear may vary when using an floating-point color 
buffer. Clears work as normal, except for clamping. The core spec is modified so 
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that clear color values are not necessarily clamped to [0,1]. For fixed-point color 
buffers, clear colors are clamped to [0,1] at clear time. 

For compatibility with conventional OpenGL, queries of 
CLEAR_COLORJVALUE may clamp components to [0,1]. A separate 
FLOAT CLEAR COLOR NV query should be added to query undamped color 
clear values. 

Floating-point textures may or may not support filtering. Texture filtering 
may be achieved in various ways. Extended OpenGL texture filtering (including 
mipmapping and support for anisotropic filters) is very computationally expensive. 
Even simple linear filtering for floating-point textures with large components is 
expensive. 

Linear filters can be implemented in fragment programs by doing multiple 
lookups into the same texture. Since fragment programs allow the use of arbitrary 
coordinates into arbitrary texture maps, this type of operation can be easily done. 

A ID linear filter can be implemented using an nxl texture rectangle with the 
following (untested) fragment program, assuming the ID coordinate is in f[TEX0].x. 
Note Table #7. 

Table #7 

ADDR H2 . xy , f [TEXO] .x, {0.0, 1.0}; 
FRCH H3.x, Rl.x; # compute the blend factor 
TEX HO, H2.x, TEXO, RECT; # lookup 1st sample 
TEX HI, H2.y, TEXO, RECT; # lookup 2nd sample 
LRPH HO, H3.x, HI, HO; # blend 
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A 2D linear filter can be implemented similarly, assuming the 2D coordinate 
is in f[TEX0].xy. Note Table #8. 

Table #8 

ADDH H2 , f [TEXO] .xyxy, {0.0, 0.0, 1.0, 1.0}; 

FRCH H3 . xy , H2.xyxy; # base weights 

ADDH H3.zw, 1.0, -H3.xyxy; # 1-base weights 

MULH H3, H3.xzxz, H3.yyww; # bilinear filter weights 

TEX HI, R2.xyxy, TEXO, RECT; # lookup 1st sample 

MULH HO, HI, H3.x/# blend 

TEX HI, R2.zyzy, TEXO, RECT; # lookup 2nd sample 

MADH HO, HI, H3.y, HO; # blend 

TEX HO, R2.xwxw, TEXO, RECT; # lookup 3rd sample 

MADH H0 7 HI, H3.z, HO; # blend 

TEX HI, R2.zwzw, TEXO, RECT; # lookup 4th sample 

MADH HO, HI, H3.w, HO; # blend 

In some embodiments, an extension such as NV_texture_rectangle may be 
required in order to use floating-point texture maps. On many graphics hardware 
platforms, texture maps are stored using a special memory encodings designed to 
optimize rendering performance. In current hardware, conventional texture maps 
usually top out at 32 bits per texel. The logic required to encode and decode 128-bit 
texels (and frame buffer pixels) optimally is substantially more complex. A simpler 
texture mapping model, such as that in NV_texture_rectangle would not necessarily 
require such logic. 

If one tries to use an floating-point texture without a fragment program, 
various things may happen. There is nothing preventing one from doing this, other 
than the driver. It is as though the texture were disabled. 
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The present embodiment may interact with the OpenGL 1 .2 imaging subset 
in various ways. The imaging subset as specified should work properly with 
floating-point color buffers. However, there may be places where one may extend 
the functionality of the imaging subset to deal with the fact that the color buffer data 
may extend beyond the "normal" [0,1] range. 

The present embodiment may interact with SGIS_generate_mipmap in 
various ways. Since the present embodiment supports only texture rectangles (which 
have no mipmaps), this issue may be moot. In the general case, mipmaps may be 
generated using a 2x2 box filter (or something fancier) where components are 
averaged. Components should not necessarily be clamped during any such mipmap 
generation. 

There are several things that maybe considered with the use of floating-point 
color buffers. First, floating-point color buffers may or may not support frame buffer 
blending. Second, floating-point texture maps may or may not support mipmapping 
or any texture filtering other than NEAREST. Third, floating-point texture maps 
may be ID, 2D or 3D, and may use the NV_texture_rectangle extension. 

It should be noted that if extensions such as EXT_paletted_texture, 
SGIX_depth_texture, and NV_texture_shader are not supported, the rows in Tables 
#2 and #3 corresponding to texture formats defined by the unsupported extension 
may be removed. 

While various embodiments have been described above, it may be understood 
that they have been presented by way of example only, and not limitation. Thus, the 
breadth and scope of a preferred embodiment may not be limited by any of the above 
described exemplary embodiments, but maybe defined only in accordance with the 
following claims and their equivalents. 
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